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A METHOD FOR CONSTRUCTING THE FUNDAMENTAL REGION OF 
A DISCONTINUOUS GROUP OF LINEAR TRANSFORMATIONS* 

BY 

J. I. HUTCHINSON 

Two methods at present exist for the construction of the fundamental region 
of a discontinuous group.f The one applies only to groups which are capable of 
extension by reflection and consists in constructing first the region for the 
extended group (which can be done by a direct process) and then combining two 
such regions that are adjacent. The other method uses the process of the con- 
tinuous reduction of a quadratic form. It is, however, tedious in application, 
and this fact appears to place a narrow restriction on its range of practical effec- 
tiveness. In the following pages I propose a much more simple and effective 
method, applicable to groups which leave a given Hermitian form invariant. 

§ 1. Groups of transformations of a single variable. 

Let the complex variable be denoted by z and its conjugate by z. Also let 
the equation of the fixed circle for the given group be 

(1) F = azz + yz -f yz + /3 = , 

in which the discriminant S = 77 — a(3 is positive (a, @ being real) and a is 
negative. The circle is then real and its interior will be defined by the 
inequality F> 0. 

Let F = be transformed into itself by the substitution 

(2) z = 7 , ad — be = 1. 

v ' cz + a 

The conditions for this are 

a ( ad — 1 ) -f yac ■+ yac + /Sec = , 

(3) aab + yad -f 706 x /3c(J= 7, 
abb + ybd + ybd + /3(dd - 1 ) = . 

Since F = is also transformed into itself by the inverse of (2), the conditions 



•Presented to the Society December 28, 1906. Received for publication January 16, 1907. 
fSee Fkicke-Klein, Automorphe Functionen, I, p. 539. 
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(3) may be replaced by the equivalent ones, 

a(dd — 1 ) — ydc — ydc + /Sec = , 
(3') — adb + yda -f ycb — @ca = y , 

abb — yba — yab + /8( ad — 1 ) = . 
The transformation (2) changes the function F into F' such that 

(4) F'=F/AA, 

(5) A = cz + d. 

Suppose that for a given point z inside the circle (1) we have AA < 1 ; 
thence follows F' > F, and the effect of the substitution has been to increase 
the value of the positive function F. If there exists a second substitution 
changing the point z into z" so that F" > F', we apply it to the preceding one 
and so proceed utitil F has reached its maximum value for the series of congru- 
ent points z , z\ z'\ • • • . Such a maximum value will be attained after a finite 
number of steps provided that the substitutions employed all belong to a group 
G which is " properly discontinuous " in the a-plane. I will name the point so 
determined the maximum point congruent to z. 

There may be several points congruent to z for which F has a maximum 
value. The number of these is equal to the order * v of the subgroup g of G 
defined by c = , since under this condition it follows from (3 ) that AA = 1 . 
The totality of maximum congruent points obtained by varying z throughout 
the interior of F will form a region R bounded by certain circles, orthogonal to 
F=Q, whose equations are 

(6) AA = 1 . 

The region It is divided by means of g into v congruent regions R l , R 2 , •• • , R v . 
Any one of the regions R. may then be taken as the fundamental region for the 
given group G. 

It only remains to show how to select from among the circles (6) those which 
bound the region R . For this purpose we observe that when F increases, the 
point z approaches the center C of the circle F = . Accordingly the boun- 
daries of R are to be selected from those A-circles (6) which pass nearest to C. 
The point of AA = 1 nearest to C is 

(1) 

in which 

(8) 
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*This order may be infinite aa in the case of the modular group when it has the real axis for 
its fixed circle. 
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The value of F at this point is 

(9) F=2(a + Vxk)lcc. 

This is evidently the greatest value attained by F on the given A-circle, and it 
may be found by the usual process for determining the maximum value" of 
a function. 

From (8) we deduce 

yycc = aycd + aycd — a?dd + XX ; 

also, from the first equation (8'), 

aficc = aydc + aycd — a 2 dd -f a 2 , 

whence, by subtraction, 

Sec = XX — a 2 . 

Using this result in (9) we have for the maximum value of F on (6), 

Vw—a 

From this it follows that the greatest values attained by F at the points defined 
by (7) are those for which the absolute values of X are the least. 

It is evident, then, that the boundary circles for the region H occur among 
those determined by the smallest values of | X | . There does not appear to be a 
sufficiently simple and general criterion by which to select out the required 
circles from among those found in this way, but a graphical construction will 
quickly indicate which ones are to be used. 

The coefficients a, 6, d are expressible in terms of X, c in the form 

« m X + 7C 7c — X iy(X — 7c) + Be — \y 

(1U) a = , a = , o = — 5 , 

v ' —a a ar 

the numbers X, c being connected by the relation 

(11) XX = a 2 + Sec 

which is the condition that the determinant shall equal 1. Equation (11) is also 
the condition that the circle AA = 1 shall be orthogonal to F = . 

To give a clearer idea of how the preceding method works out in practise, we 
consider the following examples in which a, 6, c, d are restricted to complex 
integers. 

Example I. a = l,y=O,0=— 5. 

For c = a substitution of period 2 is obtained having the origin as fixed 
point. Hence the region S consists of two congruent regions i? t , i? 2 . For 
| c | > the minimum value of XX is 26, and hence X=±5±ior±l±5£; 

Trans. Am. Hath. Soc. 18 
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cc = 5 and therefore c = ± 2 ± i or ± 1 ± 2i . The equation of the 
A-circle is (cz — X)(c» — X)= 1, which may be written 



(*-;){*-l) = ^ 



and hence its center is the point z = X/c and its radius is 1/y cc. With the 
values just obtained for X, c we construct the corresponding circles 1 , 1 , • • • , 
Fig. 1, using only those which occur in the upper half plane in which we take 




Fig. 1. 

JZ l . These do not form a closed region and we accordingly take the next higher 
value of XX which is 41, whence cc = 8 . The circles 2 , 2 , • • • are determined 
by these values, and now the region above the real axis being closed we have in 
H t thus determined the fundamental region for the given group.* 
Example II. a = — 3 , fi = y = 1. 

It is useful to observe from the relation \ + \ = — a(a + d) that X + X is 
divisible by a. For c = the only substitution of the group is identity. The 

values of X and c first to be considered are those 

for which XX = 13 , cc = 1 . Among these the 

only ones which give different substitutions 

with complex integral values for a, b, d are 

X = 3 + 2«, c = ei, e = ± 1. These determine the 

I two circles 1, 2, Fig. 2. The next higher values 

' of X and c are derived from XX = 25 , cc = 4 , 

whence we obtain the circles 3, 4, 5. We exclude 

4, 5 since they lie inside 1, 2. As the region 

about the center C is not yet closed we take the 

next case XX = 45 , cc = 9 , which determines the 

circles 6, 7, 8, 9, the last two of which are to be 

excluded. As the region R is now closed the operation is completed. 

*Cf. Fkicke-Klkin, Automorphe Functionen, X p. 479. 
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§ 2. Transformations on two variables. 

It is evident that the general method explained above is at once applicable to 
groups of substitutions on any number of variables, the region R being then 
defined by certain inequalities of the form AA > 1 . For the sake of simplicity 
I will confine myself in the present paper to the case of a group G of linear 
transformations on two complex variables x, y, the general substitution being 
written in the form 

(12) x' = (ax + by + c)/A. y = (dx + ey +/)/A 

in which A =px + qy + r. I will further suppose that the group G leaves 
the hypersphere 

(13) F=l-xx-yy = 
invariant. The conditions on the coefficients are 

ad, + dd — pp = 1 , ab + de — pq = , 

(14) 66 + ee — qq = 1 , ac -f df — pr = , 
cc + ff— rr =— 1, bc + ef— qr=Q. 

Multiply the two equations (12) by a, d respectively and add; then subtract 
p from both members of the resulting equation and use (14). This gives 

ax' + dy — p = xj A ; 
similarly, 

bx' + ey' — q = y/A and ex' +fy —r= — 1/A . 
Hence the inverse of (12) may be written 

(15) x= (ax' + dy— j3)/A', y = (bx' + ey' — q)/&', 

A' = — ex' — fy +r. 

As the inverse substitution also leaves the hypersphere invariant we have the 
conditions 

ad + 66 — cc = 1 , ad + be — cf= , 

(14) dJ + ee— j(f=l, av+bq — cr=0, 

pp + qq — rr — — 1 , dp+eq—fr=0. 

From the fourth and fifth of these equations we deduce 

a = k(fq — er), b = k(dr —fp~), c = k(dq — ep) . 

In order to evaluate the unknown 1c , we substitute these expressions for a , 6 , c 
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and obtain 



a 


b 


c 


d 


e 


/ 


P 


1 


r 



= iV 



k( - AA - BB + CXJ) = N, 

in which A , B , C are the minors corresponding to a,b, c. But since the 
inverse of the substitution (12) is 



x = 



Ax + Dy +P 



_ Bx + By + Q 

y'ar+Fy' + R' 



Cx + Fy + iT 

it follows that A A + BB — CD ' = 1 and therefore h= — N. Hence, 

a = N(er-fq) = NA, 

(16) b = N(fp-d?) = NB, 

c = N(lp -dq) NC, 

in which d , e , •• • satisfy the three relations 

pp + qq — rr= — l, 

(17) <ta + ee_//=l, 

dp + e^ — y*r = . 

We next proceed to determine the maximum point of the spread 

(18) AA=1, A=px+qy+r, 

that is, the point at which the F= 1 — xx — yy takes its maximum value when 
x, y are restricted to the locus (18). Regarding y as a dependent variable on 
account of (18) we differentiate F with respect to x, x, y and obtain as condi- 
tions for a maximum 

dy 



* + Ve x 



0, 






v + v%-o. 



By differentiating AA = 1 and substituting the expressions thus obtained for 
the derivatives, we deduce 



(19) 



P 

x= ^y, 

r 



_ pA 



r. ? A . 



y = 



-q±y- 



By substitution of these results in the second equation (18) we obtain 

A = (tt — l)yjq, 
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and by substituting in (10), 

qr pr p 

* qr" qr" q y 

Substitute now in AA = 1 and solve for y. This gives 

q( — rr ± V rr) 

y == * v _ i 

9 r(rr — l) 

Therefore 

_ - 2 ± 2 Vir) 

F= _ — - — '-. 

rr — 1 

From the first equation (17) it is evident that rr cannot be less than 1 . In 
order that the point determined may be inside the hypersphere it is necessary 
to take the lower sign. Hence, the point 

p ( Vrr — rr) q( V rr — rr) 

r{rr — 1 ) ' •* r ( rr — 1 ) 

is the maximum point for the spread AA = 1 and gives to F the value 
(20) F- 2 



Vrr + 1 



A glance at (20) shows that the largest maximum values are attained by F 
when rr has its smallest values. The corresponding A-spreads are those of (1 8) 
which pass nearest to the center of F = , and the boundaries for the region 
It are to be selected from among these. 

§ 3. Klein's group of (n + 1 ) ! collineations. 

The working out of the fundamental region for an infinite discontinuous group 
of the class just treated appears to involve a considerable amount of necessary 
detail and for that reason I reserve for a future paper the discussion of par- 
ticular groups. In the present article I will only notice, by way of illustration, 
the fundamental region E for Klein's group of (w + 1)! collineations defined 
by the homogeneous equations of transformation on the variables y„ 

( 21 ) y'i = y< H (t=i,2, ■••,n + i), 

in which a lt a 2 , ■ ■ •, a n+1 is any permutation of the numbers 1,2, • ■ •, n + 1. 
We first make the group non-homogeneous by introducing the variables 

x k — yjy„+i (&=l> 2 >--->«)- Equations (21) then become 

( 22 ) X 'k = XaJXi (fc=l. 2, ■•-,«), 
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in which x ak of the numerator is to be replaced by 1 when a k = i . We have, 
then, A = x < and the inequality conditions A A > 1 reduce to 

(23) x^-lX) (i=i, 2, ..-,»). 

Apply now to (23) the different transformations of the group. We obtain 
additional inequalities of the form 

(24) x.x.-XjX^Q (i,i = i, 2, •••,«). 

A complete set of consistent inequalities of this type will be obtained by sub- 
jecting i &ndj to the condition i>j. 

Returning now to the homogeneous variables, the conditions (28) and (24) 
become 

( 25 ) y i y i -y J y J >o, i>j vj=i,a, ■■•.m-i). 

These inequalities (some of which are superfluous) define a fundamental region 
i? for the given group. For, since any substitution of the group produces a 
permutation of the y t , it follows that at least one of the inequalities (25) is 
reversed. The only case in which this is not immediately apparent is that of the 
substitution which produces the cyclic permutation ( y x , y 2 , • • • , y n+l ) . The 
inequalities (25) are permuted except that in place of y 2 y 2 — y x y x > we now 
have y x y x — y„ +1 y n+1 > 0. But if we add this last to the n — 1 inequalities 
Vi+iVi+i - ViVi > 0(* = 2, 3, • -., w), we obtain y x y x — y 2 y 2 > 0, which is a 
reversal of the first inequality (25). Hence every point within R is trans- 
formed into a point outside H by each substitution of the group. On the other 
hand, every point outside H can be transformed into a point within. For, 
the coordinates of an arbitrarily fixed point can evidently satisfy a set of con- 
ditions of the form 

( 26 ) 2/«,ya,-ya,2/a,>0, % > j ( i, j= \ , 2, ■ ■ ; » + 1 ) . 

By choosing the a. as all possible permutations of 1 , 2 , • • • , n -f 1 we obtain 
(w+.l)! different sets of conditions (26), including (25). It is also clear 
that no other set of conditions except those enumerated would be a consistent 
one. For if in the w(w -f 1) inequalities (26) no variable occurred in the first 
term in more than n of the formulas, it would be necessary for two of the 
inequalities to have the form y k y k — y l y l > 0, y t y, — y k y k > 0, which are con- 
tradictory. Suppose, then, that y ai occurs in the first term of n + 1 of the 
inequalities (26). A similar argument will show that some other variable, say 
y^ , must occur in the first term of w of the remaining inequalities, and so on. 
We accordingly have the arrangement of (26). But since there are ( n -f 1 ) ! 
substitutions in the group and no substitution, except 1, leaves a particular set 
unaltered, it follows that any given set (26) can be transformed into (25) by a 
certain substitution of the group, and therefore any point outside H has a con- 
gruent point inside. 
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After excluding superfluous conditions it is evident that the w(n + 1) ine- 
qualities (25) reduce to * 

(27) ytny<+i-yjyi>° «=i, «,—;«)• 

The boundary 

(28) fcfc-Wm-O 

is divided by the flat space y i = y i+1 into two parts which are interchanged by 
the substitution 

^=y,+i> yJ+i-y<» y'k = Vk (*=i,»,---,<-i,*+a,-",«+i), 

while the n — 1 remaining inequalities (27) are unaltered. Hence each of the 
boundaries (28) is paired with itself. 

* The fundamental region for this group, when the variables y< are restricted to real values, 
is given by E. H. Moorb, Concerning Klein's group of ( n + 1 ) ! n-ary collineations, American 
Journal of Mathematics, vol. 22 (1900), p. 336. When the variables are real the condi- 
tions (27) become jj* +1 — yj > 0. For positive values of the y'a these reduce to exactly the con- 
ditions given by Professor Moore, p. 338 ; for negative values of the variables the two sets of 
conditions do not coincide, but they are equivalent and one may be reduced to the other by an 
"allowable change" of the fundamental region. 
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